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Method and Apparatus to Improve Efficiency in Multiple-Pass, 
Bit-Rate-Controlled Frame Encoding 



Background of the Invention 

The present invention pertains to a method and apparatus to improve efficiency in 
multiple-pass frame encoding. More particularly, the present invention pertains to a method and 
apparatus which reduces the number of processing steps that are taken to encode a frame in a 
multiple-pass, bit-rate-controlled frame encoding environment. 

Video encoding is a known procedure in the art for converting video image data into a 
digital bitstream that can then be transferred to a transmission medium or a storage medium (e.g., 
a compact disc read only memory (CD-ROM)). For example, a camera can be provided that 
generates video image data for a video capture component. The video capture component 
"captures" the video image data from the camera one frame at a time in a known manner and at a 
predetermined rate (e.g., approximately 30 frames per second). The video capture component 
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transfers the video frame data to a video compressor which may compress the video image data 
for the frame under the control of a bit rate controller. The video compressor typically includes a 
coder/decoder (codec) that compresses the video image data according to a compression 
algorithm (the compression step is often referred to as encoding). For codecs that are used in the 
transfer of video data over a transmission medium (e.g., telephone lines, the Internet, etc.), 
typical compression algorithms include any of a variety of block transform based algorithms such 
as H.261 (International Telecommunication Union - Telecommunications Standardization Sector 
(ITU-T), March, 1993), H.263 (ITU-T, December 5, 1995), MPEG-I, and MPEG-II (International 
Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 1 1 172-2 
and 13818-2). 

In a rudimentary example of video compression, the video frame of data that is captured 
by the video capture component is encoded in a single pass. In other words, the compression 
algorithm is executed with one iteration to form a compressed bit stream. A problem that is seen 
with this type of compression is that the amount of data in the bit stream may exceed (or 
substantially undershoot) the allowable bandwidth for that information. For example, in a video 
telephone application transmission of 30 frames per second video over standard phone lines 
using a single pass compression algorithm may produce too much data to be handled by the 
phone lines. Also, if the compressed video stream is being stored to a storage medium (e.g., to a 
compact disc), single pass compression may produce a bit stream that exceeds the capacity of the 
storage medium. Alternatively, if the amount of data substantially undershoots the available 
bandwidth for that information, the quality of the video data is unnecessarily reduced. 
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One known procedure for controlling the size of the bit stream or more accurately, the bit 
rate (i.e., size of the bit stream per unit time) is to employ a bit rate controller. Almost all video 
compression algorithms include a quantization parameter that has an inverse proportional effect 
on the bit rate (i.e., an increase in the quantization parameter results in a lower bit rate and vice 

5 versa). Given a target bit rate, a bit rate controller causes the video compressor to perform 

several iterations (passes) of the compression algorithm with different quantization parameters to 
achieve the target bit rate. For example, the video compressor may perform an initial pass, where 
the compression algorithm is executed in its entirety with an initial quantization parameter. 
Based on the result, a second (or retrial) pass is performed where the compression algorithm is 

10 executed in its entirety with a new quantization parameter. Several retrial passes can be 

performed, modifying the quantization parameter each time, until the target bit rate is achieved 
(within a given tolerance). The video compressor will then perform a final pass with the final 
quantization parameter. 

A problem that is seen with the multiple-pass compression using a bit rate controller is 

15 that it takes some time to perform all of the steps in each pass. Each pass includes a number of 
complex computational steps and sub-steps that take time to execute. In a videophone 
application, there may be insufficient time to perform a sufficient number of retrial passes to 
obtain the target bit rate. Also, when storing the compressed bit stream to a storage medium, it 
may take an excessive amount of time to perform as many retrial passes as needed to achieve the 

20 target bit rate. 

In view of the above, there is a need for a method and apparatus that improves the 
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efficiency of a multiple-pass video encoding operation. 

Summary of the Invention 

According to an embodiment of the present invention, a system is provided for encoding 
video image data with at least first and second encoding passes. Each encoding pass includes a 
number of executable steps and at least one of the executable steps includes a number of 
executable first order sub-steps. First order sub-steps in at least one of the first and second 
encoding passes are identified as being necessary or unnecessary for execution of the encoding 
passes. Then, the necessary sub-steps are executed during the first and second encoding passes. 

Brief Description of the Drawings 

Fig. 1 is a block diagram of system operated according to an embodiment of the present 
invention. 

Fig. 2 is a block diagram of the video compressor of Fig. 1 . 

Fig. 3 is a diagram showing the relationship of steps and sub-steps for an example of a 
video encoding procedure. 

Fig. 4 is a flow diagram of an embodiment of the method of the present invention. 

Fig. 5 is a flow diagram of the execution of the video encoding procedure determined 
according to the method of Fig. 4. 

Figs. 6a-c are more detailed flow diagrams of the method of Fig. 5. 
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Detailed Description 

Referring to Fig. 1, a general block diagram of an embodiment of the present invention is 
shown. In this embodiment, a camera 10 and a video capture component 1 1 are provided to 
generate a frame of video image data. One skilled in the art will appreciate that other devices are 
available for providing one or more frames of video data. Each frame of video data is provided 
to a video controller 12 which includes a bit rate controller 13. The uncompressed video frame 
data is sent to a video compressor 14 where it is compressed based upon a quantization parameter 
value (as described above) generated by a quantization parameter selector 15. The compressed 
video image data is sent back to the video controller 12, and the bit rate controller determines if 
the bit rate matches (or within a tolerance of) a target bit rate. Assuming that the bit rate needs to 
be modified, the uncompressed video data is re-sent to video compressor 14 for another pass with 
a new quantization parameter. The final compressed video image data is sent from video 
controller 12 to an output device 16 (e.g., a transmission or storage medium). A processor 17 
(e.g., a Pentium® processor from Intel Corporation, Santa Clara, California) may be provided to 
execute code to achieve the above-described functions. 

A block diagram of video compressor 14 is shown in Fig. 2. Uncompressed video image 
data is provided to an uncompressed data queue 22 and is then supplied to a codec 23 for the 
encoding operation. The encoding operation can be controlled by the quantization parameter 
selector 15 which may include a processor 20 coupled to a memory 21. The compressed video 
image data is transferred to a compressed data queue 24 and then to video controller 12 (Fig. 1). 
In the present invention, video image data (e.g., in a frame) is encoded through the 
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execution of an initial pass, one or more retrial passes and a final pass. Accordingly, a plurality 
of encoding passes are performed on the video image data. In this embodiment of the present 
invention, an initial pass in combination with a final pass can be considered as a single encoding 
pass and one retrial pass can be considered as a single encoding pass. As further described 
below, an encoding pass includes a number of steps that are selectively performed (i.e., certain of 
the steps are performed during a particular encoding pass and certain of the steps are not 
performed). One or more of these steps may be represented as two or more first-order sub-steps; 
one or more first order sub-steps may be represented as two or more second-order sub-steps and 
so on. Each step and sub-step represents a video encoding procedure in a particular encoding 
pass. 

Referring to Fig. 3, a diagram of the steps and sub-steps that may be performed in a 
plurality of types of encoding passes is shown. According to a method of the present invention, a 
systematic approach is taken to determine which sub-steps are necessary for each of the encoding 
passes. In this example, a sub-step is necessary if its execution is dependent on the quantization 
parameter (a value that is typically changed before performing a retrial encoding pass). As seen 
in Fig. 3, wavelet decomposition is a first step that is performed during an initial trial encoding 
pass. The "It" in that area indicates that the step is necessary to be performed for that encoding 
pass. Accordingly, motion estimation and difference image encoding are also necessary steps 
that are performed during an initial trial encoding pass. 

For the retrial encoding pass, wavelet decomposition and motion estimation are steps that 
are not necessary to be performed and are often excluded during this pass. Because the final 
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encoding pass is complimentary to the initial trial encoding pass, it is expected that these same 
two steps are not performed during the final encoding pass. 

The difference image encoding pass step comprises a number of first order sub-steps. In 
the prior art, the entire difference image encoding step (i.e., all of its component sub-steps) are 
performed for the initial-trial, retrial and final encoding passes. According to a method of the 
present invention, it is determined whether each first order sub-step is necessary for a given 
encoding pass. If it is, then that sub-step is executed, if it is not, then that sub-step is skipped 
resulting in a reduction in the amount of time required to complete a given encoding pass. 
Referring back to Fig. 3, the first order sub-steps for the initial-trial, retrial and final encoding 
passes are shown. The difference encoding step includes the following six sub-steps: calculate 
average activity, determine adaptive quantization level, perform a forward block transform, 
perform a block quantization, zig-zag run-length coding, and generation of the bit stream. As 
indicated by the tt under difference image encoding with the initial-trial encoding pass, each of 
the sub-steps for this step are necessary and are marked with K's. 

For the retrial encoding pass, the difference image encoding step is marked with a "?" 
indicating that not all of the first order sub-steps are necessary for execution of this encoding 
step. In the sub-steps of the difference image encoding step, only four of the sub-steps are 
necessary. Accordingly, with an embodiment of the present invention, the calculate average 
activity and forward block transform steps are not performed, saving time during each retrial 
encoding pass. With the final encoding pass, none of the sub-steps are necessary except for the 
generate bit stream sub-step. As indicated in Fig. 3, this sub-step is made up of a number of 
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second order sub-steps (i.e.. generate group of pictures (GOP), picture and band header as well as 
generate tile and below bit stream). According to the method of the present invention it is 
determined that only the first of these second order sub-steps are necessary while the other is not. 
Rather than perform both sub-steps, only the first of these is performed according to an 
embodiment of the present invention. 

As indicated in Fig. 3, the difference image decoding step includes a plurality of sub-steps 
(i.e., block dequantization and inverse transform). For the initial-trial and retrial encoding steps, 
the block dequantization sub-step is necessary while the inverse transform step is not. According 
to an embodiment of the present invention, only the block dequantization sub-step is performed 
using the DC (direct current) coefficient only. Both sub-steps are performed in the final 
encoding pass. 

An embodiment of the method of the present invention is shown in Fig. 4. In step 41, a 
review is made of the steps of a first encoding pass. In step 45, an identification is made of those 
steps that are necessary and those that are unnecessary for the first encoding pass. In decision 
block 47, it is determined whether there are any first order sub-steps to the steps in the first 
encoding pass. If there are, then control passes to step 51 for identification of first order 
sub-steps that are necessary or unnecessary for proper execution of the encoding pass. In this 
embodiment of the present invention, a step or sub-step can be identified as necessary by setting 
a flag associated with that set of code in a separate table, removal of that set of code from the 
system, etc. If there are no first order sub-steps to the steps in the first encoding pass, then 
control passes to decision block 49 to determine if there is an additional encoding pass to be 
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performed (e.g., a retrial encoding pass). If there is, then control passes to step 43 to move the 
analysis to the next encoding pass. 

After the first order-sub steps are identified as necessary or unnecessary in step 51, 
control passes to decision block 53 to determine if there are any second order sub-steps to the 
first order sub-steps of the encoding pass. If there are, then control passes to step 55 where the 
second order sub-steps are identified as necessary or unnecessary for the proper execution of the 
encoding pass. If there are not, control passes back to decision block 49. The process can be 
continued for as many levels of sub-steps that appear in the encoding pass. For example, in 
decision block 57 it is determined whether there are any n order sub-steps to the n-1 order 
sub-steps in the encoding pass (where n is an integer greater than or equal to 3). If there are, then 
control passes to step 59 where n order sub-steps are identified as necessary or unnecessary for 
proper execution of the encoding pass. 

Once the steps and sub-steps are identified as being necessary or unnecessary for proper 
execution of each encoding pass, the necessary steps and sub-steps in encoding passes are 
executed (see step 61 in Fig. 4). In this embodiment of the present invention, a step or sub-step 
can be identified as necessary by setting a flag associated with that set of code in a separate table. 
Accordingly, in this embodiment, when the encoding pass is executed, only steps and sub-steps 
that have a set flag are executed in the encoding passes. This can result in a quicker execution of 
the encoding passes, making the processing of video data more efficient. If there is a limited 
amount of time available to prepare a video frame of data, the present invention may allow an 
increased number of encoding passes to be performed, thus improving performance. 
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Referring to Figs. 5 and 6a-c, flowcharts are presented showing the performance of 
encoding passes using an embodiment of the present invention. In step 101, an initial trial pass is 
performed with an initial quantization parameter q 0 . In decision block 103, it is determined if 
any exit criteria have been met. Examples of exit criteria include: 1) whether the current bit rate 
matches a target bit rate (within a tolerance range); 2) whether the number of retrial encoding 
passes has exceeded a certain predetermined threshold; 3) whether the amount of time available 
for encoding a given video frame has expired; and 4) whether the quantization parameter can no 
longer be modified (e.g., it is set to the value of 0 and the encoding algorithm calls for a lower 
value). If the exit criteria is not met, control passes to step 105 where the quantization parameter 
q iM is adjusted based upon q ; and the data rate. Then in step 107, a retrial encoding pass is 
performed with the quantization parameter q iM . When the exit criteria is met, control passes to 
step 109, where the final encoding pass is performed. 

A more detailed flow chart for Fig. 5 is shown in Figs. 6a-c according to an embodiment 
of the present invention. In Fig. 6a, a flowchart for an initial trial encoding pass is shown. In 
step 1 1 1, a wavelet decomposition operation is performed (e.g., dividing a video frame into a 
plurality of smaller sub-frames). Then in step 113, motion prediction is performed on the 
individual sub-frames (e.g., estimating direction and amount of motion based on current and 
previous sub-frames). In step 115, the average activity for each sub-frames is calculated and 
stored. Based on this average activity, the quantization parameter is determined (step 117). In 
step 1 19, the forward DCT (discrete cosine transform) is calculated and stored for a block (e.g., 
16x16 picture elements) of a sub-frame. In step 121, a block quantization operation is performed 
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using the term q 0 . In step 123. zig-zag coding is performed (e.g., video image data is encoding in 
diagonal directions across the block). In step 125, a DCT block transform is performed for the 
block and in step 127, the bitstream is generated with the results of the block transform 
operations. In step 129, the DC coefficient is dequantized as the only sub-step performed for the 
difference image decoding step (Fig. 3). Steps 1 15-29 can be repeated for each block of the 
video frame. 

Referring to Fig. 6b, a flowchart of a retrial encoding pass is shown. In step 131, an 
adaptive quantization parameter (e.g., q i( ,) is determined based on the average activity pre- 
calculated in the initial trial pass. In step 133, a block quantization is performed using the 
quantization parameter of step 131 upon pre-calculated DCT coefficients from the initial trial 
encoding pass. In steps 135 and 137, zig-zag coding is performed and the bitstream is generated, 
respectively. According to an embodiment of the present invention, steps 131-37 are the only 
sub-steps of the difference image encoding step (Fig. 3) that are performed in the retrial encoding 
pass (because these sub-steps were identified previously as being necessary). In step 139, the DC 
coefficient is dequantized as the only sub-step of the difference image decoding step that is 
performed during this pass. Steps 131-39 can be repeated for each block. 

Referring to Fig. 6c, a flowchart of a final encoding pass is shown. In steps 141 and 143, 
the entire difference image decoding step (Fig. 3) is performed (i.e., block dequantization and 
DCT inverse transform, respectively). In step 145, a motion compensation operation is 
performed for the video frame. In step 147, fields in the bitstream are filled out (e.g., the GOP, 
picture, and band header information) as the only second order sub-step performed for the 
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"generate bitstream" sub-step (Fig. 3). In step 149, a wavelet recompensation procedure is 
performed to reconstruct the video frame. 

In comparing the procedural steps that are performed in Figs. 6a-c and the steps and sub- 
steps that are typically performed in Fig. 3, a reduction in the amount of processing time for each 
5 encoding pass can be achieved. 

Although embodiments are specifically illustrated and described herein, it will be 
appreciated that modifications and variations of the present invention are covered by the above 
teachings and within the purview of the appended claims without departing from the spirit and 
intended scope of the invention. For example, many steps of the method of the present invention 
10 can be stored on a storage medium as executable code that is executed by a processor or the like. 
Also, one skilled in the art will appreciate that many of the method steps that are shown can be 
implemented using hardware components in addition to or instead of the execution of software 
code. 
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What is claimed is: 

1 1 . In a system for encoding video image data with at least first and second encoding passes, 

2 where each encoding pass includes a number of executable steps and at least one of said 

3 executable steps includes a number of executable first order sub-steps, a method for encoding 

4 video image data comprising: 

5 (a) identifying first order sub-steps in at least one of said first and second encoding 

6 passes as being necessary or unnecessary for execution of said encoding passes; and 

7 (b) executing said necessary sub-steps during said first and second encoding passes. 

1 2. The method of claim 1 wherein in said identifying step, all of said first order sub-steps in 

2 said first and second encoding passes are identified as being necessary or unnecessary for 

3 execution of said encoding passes. 

1 3. The method of claim 1 wherein at least one of said first order sub-steps includes a 

2 plurality of executable second order sub-steps, wherein after step (a), said method further 

3 comprising: 

4 (a 2 ) identifying second order sub-steps in at least one of said first and second encoding 

5 passes as being necessary or unnecessary for execution of said encoding passes. 

1 4. The method of claim 3 wherein in step (a 2 ), all of said second order sub-steps in said first 

2 and second encoding passes are identified as being necessary or unnecessary for execution of said 
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encoding passes. 



1 5. The method of claim 3 wherein at least one of said executable first order sub-steps 

2 includes a plurality of n-1 order sub-steps and at least one of said n-1 order sub-steps includes a 

3 plurality of executable n order sub-steps where n is an integer greater than or equal to three, 

4 wherein after step (a 2 ), said method further comprising: 

5 (a n ) identifying n-1 order sub-steps in at least one of said first and second encoding 

6 passes as being necessary or unnecessary for execution of said encoding passes. 

1 6. The method of claim 5 wherein in step (a n ), all of said n order sub-steps in said first and 

2 second encoding passes are identified as being necessary or unnecessary for execution of said 

3 encoding passes. 

1 7. A set of instructions residing in a storage medium, said set of instructions capable of 

2 being executed by a processor to implement a method for encoding video image data with at least 

3 first and second encoding passes, where each encoding pass includes a number of executable 

4 steps and at least one of said executable steps includes a number of executable first order sub- 

5 steps, such that first order sub-steps in at least one of said first and second encoding passes are 

6 identified as being necessary or unnecessary for execution of said encoding passes, the method 

7 comprising: 

8 (a) executing said necessary sub-steps during said first and second encoding passes. 
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1 8. The set of instructions of claim 7, wherein in said identifying step, all of said first order 

2 sub-steps in said first and second encoding passes are identified as being necessary or 

3 unnecessary for execution of said encoding passes. 

1 9. The set of instructions of claim 7, wherein at least one of said first order sub-steps 

2 includes a plurality of executable second order sub-steps, wherein second order sub-steps in at 

3 least one of said first and second encoding passes are identified as being necessary or 

4 unnecessary for execution of said encoding passes. 

1 10. The set of instructions of claim 9, wherein all of said second order sub-steps in said first 

2 and second encoding passes are identified as being necessary or unnecessary for execution of said 

3 encoding passes. 

1 11. The set of instructions of claim 7, wherein at least one of said executable first order sub- 

2 steps includes a plurality of n-1 order sub-steps and at least one of said n-1 order sub-steps 

3 includes a plurality of executable n order sub-steps where n is greater than or equal to three, 

4 wherein n-1 order sub-steps in at least one of said first and second encoding passes are identified 

5 as being necessary or unnecessary for execution of said encoding passes. 
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1 12. The set of instructions of claim 11, wherein all of said n order sub-steps in said first and 

2 second encoding passes are identified as being necessary or unnecessary for execution of said 

3 encoding passes. 

1 13. A system for encoding video image data with at least first and second encoding passes, 

2 where each encoding pass includes a number of executable steps and at least one of said 

3 executable steps includes a number of executable first order sub-steps, said first order sub-steps 

4 in at least one of said first and second encoding passes being identified as necessary or 

5 unnecessary for execution of said encoding passes, said system including: 

J 6 a video compressor adapted to encode video image data during said at least first and 

H 7 second encoding passes; and 

^ 8 a bit rate controller coupled to said video compressor and adapted to control said video 

. " 9 compressor during said at least first and second encoding passes, such that said video compressor 

Ql 0 is adapted to execute said necessary sub-steps during said first and second encoding passes. 

W l 14. The system of claim 13 wherein said video compressor further comprises: 

2 an encoder/decoder adapted to encode video image data during said at least first and 

3 second encoding passes. 

1 15. The system of claim 14 wherein all of said first order sub-steps in said first and second 

2 encoding passes are identified as being necessary or unnecessary. 
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1 16. The system of claim 1 5 wherein at least one of said first order sub-steps includes a 

2 plurality of executable second order sub-steps and said second order sub-steps are identified as 

3 necessary or unnecessary. 

1 17. The system of claim 15 wherein all of said second order sub-steps in said first and second 

2 encoding passes are identified as being necessary or unnecessary. 

1 18. The system of claim 16, wherein at least one of said executable first order sub-steps 

2 includes a plurality of n-1 order sub-steps and at least one of said n-1 order sub-steps includes a 

3 plurality of executable n order sub-steps where n is an integer greater than or equal to three, and 

4 n-1 order sub-steps are identified in at least one of said first and second encoding passes as being 

5 necessary or unnecessary. 

1 19. The system of claim 1 8 wherein all of said n order sub-steps in said first and second 

2 encoding passes are identified as being necessary or unnecessary. 
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Abstract of the Disclosure 



Video image data is commonly encoded using a video encoder operating under the 
control of a bit-rate controller where a plurality of encoding passes are performed so as to 
improve quality in each video frame. According to an embodiment of the present invention, a 
systematic review of the steps and sub-steps of the encoding passes is performed so as to identify 
those sub-steps which are necessary and those that are unnecessary to the execution of the 
encoding passes. Then, those steps identified as being necessary are executed during the 
encoding passes. Doing so reduces the amount of processor computation that is needed to 
perform a given number of encoding passes allowing the passes to be performed quicker or at a 
greater rate, thus improving quality. 
SJ1-2944 
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ATTORNEY'S DOCKET NO. 2207/6039 PATENT 
DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 



As a below named inventor. I hereby declare that: 

M> residence post office address, and citizenship are as stated below next to my name, 

I believe I am the original, first, and sole inventor of the subject matter that is claimed and for which a patent is sought on the invention 
entitled METHOD AND APPARATUS TO IMPROV E EFFICIENCY IN MULTIPLE-PASS, BI I -RATE-CONTROLLED FRAME 
ENCODING 

the specification of which 

_X_ is attached hereto. 

was filed on as United States Application Number or PCT International Application Number and 

was amended on 

(if applicable) 

I hereby state that I have reviewed and understand the contents of the above identified specification, including the claim(s). as amended by 
any amendment referred to above. I do not know and do not believe that the claimed invention was ever known or used in the United States of 
America before my invention thereof or patented or described in any printed publication in any country before my invention thereof or more than one 
year prior to this application, that the same was not in public use or on sale in the United States of America more than one year prior to this 
application, and that the invention has not been patented or made the subject of an inventor's certificate issued before the date of this application in 
any country foreign to the United States of America on an application filed by me or my legal representatives or assigns more than twelve months (for 
a utility patent application) or six months (for a design patent application) prior to this application. 

I acknowledge the duty to disclose information which is material to the examination of this application in accordance with Title 37, Code of 
Federal Regulations. § 1 .56(a). a copy of which is attached. 



PRIOR FOREIGN APPLICATION(S) 

I hereby claim foreign priority benefits under Title 35, United States Code. § 1 19(a)-(d), of any foreign application(s) for patent or 
inventor's certificate listed below and have also identified below any foreign application for patent or inventor's certificated having a filing date before 
that of the application on which priority is claimed: 



APPLICATION NUMBER 


COUNTRY 


FILFNG DATE 
(day. month, year) 


PRIORI TY CLAIMED 
Yes No 













PRIOR UNITED STATES APPLICA TION(S) 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States application(s) listed below and, insofar as the subject 
matter of each of the claims of this application is not disclosed in the prior United States application in the manner provided by the first paragraph of 
Title 35, United States Code, § 1 12. 1 acknowledge the duty to disclose material information as defined in Title 37, Code of Federal Regulations, § 
1.56(a) which occurred between the filing date of the prior application and the national or PCT international filing date of this application. 



APPLICATION NUMBER 


FILING DATE 
(day, month, year) 


STATUS 
(i.e. Patented. Pending, Abandoned) 









POWER OF ATTORNEY: I hereby appoint: 



Paul H. Heller (Reg. No. 21.074); John C. Altmillcr (Reg. No. 25,951); Felix L. D'Arienzo, Jr. (Reg. No. 27,631); Shawn W. O'Dowd (Reg. No. 
34,687) of KENYON & KENYON with offices located at 1025 Connecticut Ave.. N.W, Washington. D.C. 20036, telephone (202)429-1776. and 
James E. Jacobson, Jr. (Reg. No. 31.626): Thomas C. Reynolds (Reg. No. 32.488); Raymond J. Wemer (Reg. No. 34,752); Richard C. Calderwood 
(Reg. No. 35,468); Joseph R. Bond (Reg. No. 36,458); Naomi Obinata (Reg. No. 39,320) of INTEL CORPORATION my attorneys with full power of 
substitution and revocation, to prosecute this application and to transact all business in the Patent and Trademark Office connected herewith. 
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Title 37, Code of Federal Regulations, Section 1.56 
Duty to Disclose Information Material to Patentability 



(a) A patent by its very nature is affected with a public interest. The public interest is best served, and the most 
effective patent examination occurs when, at the time an application is being examined, the Office is aware of an evaluates 
the teachings of all information material to patentability. Each individual associated with the filing and prosecution of a 
patent application has a duty of candor and good faith in dealing with the Office, which includes a duty to disclose to the 
Office all information known to that individual to be material to patentability as defined in this section. The duty to 
disclosure information exists with respect to each pending claim until the claim is cancelled or withdrawn from consideration, 
or the application becomes abandoned. Information material to the patentability of a claim that is cancelled or withdrawn 
from consideration need not be submitted if the information is not material to the patentability of any claim remaining under 
consideration in the application. There is no duty to submit information which is not material to the patentability is deemed 
to be satisfied if all information known to be material to patentability of any claim issued in a patent was cited by the Office 
or submitted to the Office in the manner prescribed by §§ 1.97(b)-(d) and 1.98. However, no patent will be granted on an 
application in connection with which fraud on the Office was practiced or attempted or the duty of disclosure was violated 
through bad faith or intentional misconduct. The Office encourages applicants to carefully examine: 

(1) Prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) The closest information over which individuals associated with the filing or prosecution of a patent 
application believe any pending claim patentably defines, to make sure that any material information contained therein 
disclosed to the Office. 

(b) Under this section, information is material to patentability when it is not cumulative to information already 
of record or being made or record in the application, and 

(1) It establishes, by itself or in combination with other information, a prima facie case of unpatentability of a 

claim; or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(I) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a claim is unpatentable 
under the preponderance of evidence, burden-of-proof standard, giving each term in the claim its broadest reasonable 
construction consistent with the specification, and before any consideration is given to evidence which may be submitted in 
an attempt to establish a contrary conclusion of patentability. 

(c) Individuals associated with the filing or prosecution of a patent application within the meaning of this 
section are: 



( 1 ) Each inventor named in the application; 

(2) Each attorney or agent who prepares or prosecutes the application: and 

(3) Every other person who is substantively involved in the preparation or prosecution of the application and 
who is associated with the inventor, with the assignee or with anyone to whom there is an obligation to assign the application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by disclosing 
information to the attorney, agent, or inventor. 



